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Abstract — Limited feedback is a paradigm for the feedback of 
channel state information in wireless systems. In multiple antenna 
wireless systems, limited feedback usually entails quantizing a 
source that lives on the Grassmann manifold. Most work on 
limited feedback beamforming considered single-shot quantiza- 
tion. In wireless systems, however, the channel is temporally 
correlated, which can be used to reduce feedback require- 
ments. Unfortunately, conventional predictive quantization does 
not incorporate the non-Euclidean structure of the Grassmann 
manifold. In this paper, we propose a Grassmannian predictive 
coding algorithm where the differential geometric structure of 
the Grassmann manifold is used to formulate a predictive vector 
quantization encoder and decoder. We analyze the quantization 
error and derive bounds on the distortion attained by the 
proposed algorithm. We apply the algorithm to a multiuser 
multiple-input multiple-output wireless system and show that it 
improves the achievable sum rate as the temporal correlation of 
the channel increases. 

Index Terms — Prediction methods, correlation, feedback com- 
munication, MIMO systems, quantization, vector quantization. 



I. Introduction 

Multiple antenna wireless communication systems can im- 
prove throughput and reliability when channel state infor- 
mation (CSI) is known at the transmitter Limited feedback 
is a flexible approach for providing quantized channel state 
information from the receiver to the transmitter. Most prior 
work on limited feedback use one-shot feedback that makes 
an instantaneous channel measurement and sends back the 
quantized CSI without memory. In a mobile environment, 
however, the channel exhibits coherence over time that may 
be exploited to improve the resolution of the quantized CSI at 
the transmitter 

Predictive vector quantization (PVQ) is a class of memory 
based coding techniques used in applications such as speech, 
image, and video processing [l]-[4]. In PVQ, the error signal 
between the current observed vector and the predicted vector 
based on past observations is quantized. When the observed 
data to be encoded are correlated, usually in time or space, 
quantizing the error signal leads to lower distortion compared 
with memoryless vector quantization [3]. The effectiveness 
of PVQ rests on the correlation exhibited by the data, the 
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prediction function, and the quantization technique employed. 
Due to temporal correlation in the propagation channel, it is 
natural to consider predictive coding approach for encoding 
CSI in temporally correlated channels. Classical PVQ has been 
applied for signals in Unear vector space where the usual dif- 
ference, addition, and prediction are well understood. Unfor- 
tunately, in multiple antenna limited feedback beamforming in 
wireless communication, the CSI to be encoded Uves often on 
the Grassmann manifold. The Grassmann manifold, denoted 
Gn.pi is the set of p-dimensional subspaces of n-dimensional 
EucUdean space. Because it is a nonlinear manifold, extending 
classical PVQ is challenging since the usual linear operations, 
not to mention important functions like prediction, are not well 
defined. 

Motivated by applications in multiple-input multiple -output 
(MIMO) wireless communication, there has been research 
in analyzing [5], quantizing [6]-[8], and coding [9]-[ll] on 
the Grassmann manifold driven in part by applications to 
commercial wireless systems [12|, 1 13|. Prior work exists for 
designing suitable memoryless quantization codebooks such 
as Grassmannian line packing [14], vector quantization [15], 
Grassmannian frames [16], and Kerdock codebooks [17] (e.g., 
also see the references in [18]). Several techniques have been 
previously proposed to exploit the temporal correlation of the 
propagation channel [19]-[27]. In [19], [20], modeling the 
feedback state transitions allow the net feedback rate to be 
reduced. The resolution, however, is fixed by the codebook 
size. To improve the quantization error, an adaptive codebook 
approach was proposed that can adapt to a given channel 
distribution [21]. Additional feedback overhead to retrain or 
synchronize the pre-computed codebooks may be needed when 
the channel distribution changes. Alternatively, a hierarchical 
codebook strategy uses two codebooks, coarse and fine, for 
layered feedback in temporally correlated channel [22], [23]. 
A codeword describing the coarse encoding region is updated 
infrequently and a finer local codebook is used for frequent 
feedback. A more flexible approach is to use a progressive 
refinement strategy in which rotation and scaUng are applied 
to structured codebook so as to provide high resolution 
feedback [24], [25]. An approach related to our paper is 
the complex Householder transform based PVQ-Uke tech- 
nique for correlated normalized channel vectors in multiple- 
input single-output communication systems [26]. The current 
vector channel is decomposed into previous vector channel 
and weighted sum of orthogonal subspaces to represent the 
temporal variation. While the algorithm is presented in the 
form of PVQ, the actual operation is successive decomposition 
and projection using the complex Householder transform with 
unit delay which was shown to be optimal for the specific 
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application. A differential feedback approach using a rotation 
codebook has been proposed for spatial multiplexing system 
[27]. They require long term correlation statistics to design 
suitable codebook and exploit the structure of the Rieman- 
nian manifold. Unfortunately, the codebooks are specific to 
the given long term statistics and may become outdated. 
The Grassmannian predictive coding technique proposed in 
this paper was presented in part in [28]. We proposed the 
Grassmannian predictive coding algorithm applied to multiuser 
MIMO system. We did not, however, provide the details of 
derivation nor consider an efficient codebook representation 
and a distortion analysis. 

In this paper, we propose a predictive coding algorithm for 
correlated data on the Grassmann manifold, which we call 
the Grassmannian predictive coding (GPC) algorithm. The 
GPC algorithm is derived using the intrinsic geometry of 
the manifold and corresponding mathematical operations that 
respect the curved manifold structure. The main contributions 
of this paper are as follows. 

• Grassmannian predictive coding algorithm: We propose 
a framework for predictive coding on the Grassmann 
manifold. The key idea of our approach is to use the 
tangent vector to establish the notion of a difference 
between points on the manifold. The proposed prediction 
function uses parallel transport as a one step prediction. 
The prediction step uses the inmiediate past difference; 
formulating higher order prediction function remains for 
future work. The concepts of tangent vector and parallel 
transport have been used in [29] for optimization prob- 
lems, but have not been exploited to develop a predictive 
coding concept. 

• Efficient codebook structure: A design of tangent space 
codebook using Lloyd algorithm is proposed. The code- 
book Uves in the tangent space of C^* with magnitude 
dependent on the correlation exhibited by the charmel and 
prediction function. An efficient codebook storage strat- 
egy is proposed exploiting the direction and magnitude 
decomposition of the tangent space vector. 

• Distortion bounds: Based on a geometric interpretation of 
our GPC algorithm, a simple model of the quantization 
region is obtained. Using metric volume computations 
on the Grassmann manifold [7], lower and upper bounds 
on the quantization error are derived. We compare the 
obtained bounds with distortion obtained in simulations. 
Furthermore, we show that the distortion for the proposed 
GPC algorithm is lower than the lower bound of memo- 
ryless quantizer distortion for a given codebook size. 

• Application to limited feedback multiuser MIMO systems: 
We apply the GPC algorithm for limited feedback zero- 
forcing multiuser MIMO systems with multiple transmit 
antennas and a single receive antenna at each mobile 
terminal [30]. We show that the proposed GPC algorithm 
provides substantial sum rate improvement over memo- 
ryless random codebook technique with same feedback 
rate [30]. The sum rate improvement, however, depends 
on the channel correlation. When the channel is highly 
correlated, the proposed GPC algorithm is shown to 



provide sum rates close to a system with perfect CSI 

at the transmitter, i.e., infinite feedback. 
Notation: We use lower case bold letters, e.g., v, to denote 
vectors and upper case bold letters, e.g., H, to denote matrices. 
A 2-norm is denoted by || • j] and a normalized vector is denoted 
by V = v/||v||. The n x n identity matrix is denoted by I„. 
The space of integers and complex nimibers are denoted by N 
and C, respectively, with an appropriate superscript to denote 
the dimension of the respective spaces. We use ^, *, and ^ 
to denote the transposition, Hermitian transpose, and pseudo 
inverse, respectively. The n-th column entry of a matrix A is 
denoted by [A]:^„. The expectation is denoted E[-]. 

II. System Model 

In this paper we apply GPC algorithm to limited feedback 
multiuser MIMO communication. It can also be applied to 
single user MIMO and to multi-cell MIMO systems. Multiple 
user MIMO is a challenging appUcation of limited feedback as 
it requires high resolution quantization [30] and is known to be 
sensitive to channel variations [31]. We consider a multiuser 
limited feedback system with Nt tiansmit antennas at the base 
station and U < Nt mobile users each equipped with a single 
receive antenna. To isolate the impact of using predictive cod- 
ing for limited feedback, we assume that U users are scheduled 
a priori from possibly large number of user pool; we do not 
consider scheduling or the effects of multiuser diversity in this 
paper. Let Su[k], v„[A;], and h„[fc] be the complex transmit 
symbol, Nt x 1 unit norm beamforming vector, and Nt x 1 
channel vector for u-th user at time index k, respectively. We 
assume that the transmit vector s = [si[k] ■ ■ ■ su[k]]'^ satisfies 
the total transmit power constraint E[||s|p] < P. Then, the 
input-output relationship for u-th user may be written as 

u 

yu[k] = h;[A;]v„[A;]s„[A:] + K[k] ^ v„[fc]s„[fc] + n„[fc] 

(1) 

where n„ is an independent identically disttibuted (i.i.d.) zero 
mean complex Gaussian noise with unit variance at user u. The 
first term in (1) is the desired signal for u-th user while the 
second summation term is the interference signal. The signal 
to interference plus noise ratio (SINR) for the u-th user can 
be written as 

SINR„ = u}"^ . (2) 

If the transmit signal s„ is assumed to be Gaussian, the 
achievable rate for user u is given by 

7e„ = log2(l+SINR„) (3) 

and the sum rate TZ = Y^^=i T^u- 

The SINR expression (2) shows that the amount of inter- 
ference depends on the design of the beamforming vectors. 
Zero forcing uses beamforming vectors such that they are 
orthogonal to other user's channel vectors, i.e., h„ [fc] v„ \k] = 
for n ^ w, to null the inter user interference [32]. Let 
H = [hi • • • h„]* be the U x Nt composite channel ma- 
trix. With perfect CSI, the interference can be completely 
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eliminated by choosing the unit norm beamfonning vector as 
the normalized columns of pseudo inverse composite channel 
matrix, i.e., v„ = [H^]._„/|| [H^]._„||. Zero forcing creates 
U interference free parallel channels providing nearly linear 
throughput increase as a function of number of users but with 
some power loss due to normalization [33 J. 

In limited feedback multiuser MIMO systems, quantized 
CSI is fed back to the transmitter from each user [30], [31]. 
Assuming that a perfect channel estimate h„ is obtained, 
we consider the quantization of the channel direction g„ = 
hu/||h„|| and assume that the scalar channel gain is known 
perfectly [31]. We assume that the channel gain is dependent 
on the longer term statistics that varies much slower than 
the channel direction. Since the channel gain is a real valued 
quantity that is easier to feedback, we assume that the channel 
gain is known perfectly at the transmitter and consider the 
effects of the channel shape quantization only [31]. In this 
regime, the SINR can be rewritten as 



SINR„ 



(4) 



We make two observation from (4). First, if the channel vector 
hu is an i.i.d. vector distributed according to CAf{0, 1), gu is 
isotropically distributed on the iVj-dimensional hyper-sphere. 
Second, due to the absolute value around g*v„, the SINR 
is independent of arbitrary unitary rotations of the channel 
direction. That is, |g>„P = |e^^g*v„|2 for 6 e (0,27r]. 
Therefore, we may identify the space of channel shape as 
the Grassmannian manifold. Thus, the problem of transmit 
beamformer design is to feedback channel shapes on the 
Grassmann manifold from each user u, and use the collected 
channel shape information at the transmitter to design the 
beamforming vectors by zero forcing. 

In conventional codebook based limited feedback multiuser 
MIMO systems, each user has a normalized channel vector 
codebook of size A^rc which is shared with the transmit- 
ter [30], [31]. The transmitter maintains U tables of size N^c 
codebooks. Each user selects the codeword with minimum 
chordal distance from the normalized channel vector estimate. 
The index of the selected codeword using log2(A'Rc) bits is fed 
back to the transmitter. The transmitter collects the decoded 
channel vectors h„ for each user u to form the composite 
channel matrix H = [h„ • • • h„]*. The beamforming vectors 
are computed as v„ = [H''']. „/||[H''']. Using a random 
codebook, it was shown in [30] that sum rate performance 
becomes interference Umited as signal to noise ratio (SNR) 
increases and that codebook size needs to be increased lin- 
early as a function of SNR, in dB, to maintain multiplexing 
gain. Herein, lies the practical Umitation of the conventional 
codebook approach: the codebook size that approaches the 
achievable sum rate becomes impractical even for moderate 
SNR. The proposed GPC algorithm overcomes this problem. 

III. Grassmann Manifold: Preliminaries 

The geometric and hnear algebraic properties of the Grass- 
mann manifold will be fundamental in derivation of our 
proposed algorithm. In this section we review key definitions, 



properties, and mathematical tools pertaining to designing 
algorithms for the Grassmann manifold. Then we propose a 
predictor on the Grassmann manifold built from the tangent 
vector, mapping from the tangent onto the manifold, and 
parallel transport. 

Let W„ = {X e C">^" : X*X = I„} be the unitary group 
formed by n x n unitary matrices. For p < n, the Grassmann 
manifold, Qn,p, is the set of subspaces spanned by the columns 
of the quotient group Un/Un-p- It may also be identified as the 
quotient space of the unitary group, Un/ iUn-p x Up). A point 
X e Qn,p may be considered as an equivalence class, i.e., 
[X] := {XUp : Up G Up}. For notational brevity, we denote 
X € Qn,p to mean the equivalence class of matrices whose 
columns span the same p-dimensional subspace. For numerical 
computation, we understand X e Gn,p to be one representative 
of the equivalence class. The Grassmann manifold is a smooth 
topological manifold with a locally Euclidean property and 
smooth tangent space structure [34], both of which will be 
essential in the derivation of the proposed algorithm. In this 
paper, we consider the Grassmann manifold the general 
case of p > 1 is a topic of future work. 

Let the inner product of x, y G ^n.i be denoted by p = 
x*y. Let 9 = cos~^(|p|) be the subspace angle between x and 
y [35]. The chordal distance metric for Qn^i is given by [29], 
[36] 



d(x,y) = Vl - \P\- 
= |sin6»|. 



(5) 



For notational brevity, we use d without the arguments when 
there is no confusion. Unlike the arc length, given by \9\, 
the chordal distance is differentiable everywhere and provides 
a close approximation of the arc length when the points are 
close [37]. 

Using the chordal distance metric, we define the correlation 
of two sequences {x[fc]}A.gN. {y[2]}jgN e G^,! by Cx,yW = 
Ei;[d(x[fc],y[A; + n])] which can be interpreted as the mean 
chordal distance between two sequences on the Grassmann 
manifold. 

Based on the smooth manifold structure of the Grassmann 
manifold, it is possible to relate two points x[fc],x[fc + 1] e 
Qn.i by considering the tangent vector emanating from x[fc] to 
x[fc + 1]. Fig. 1 illustrates the concept. The tangent has been 
used successfully in the development of Newton and conjugate 
gradient algorithms with orthogonality constraints [29], [38]- 
[40]. We utilize the tangent relationship for its computational 
benefits and geometric insight to the problem. 

Lemma 1 (Tangent): If x[fc], x[fc + 1] G Gn,ii then the 
tangent vector emanating from x[fc] to x[A: -I- 1] is 

d\ x[fc + l]/p-x[A;] 
W ||x[fc + l]/p-x[fc]|| 

such that ||e|| = tan~^(d/|p|) is the arc length between x[A;] 
and x[A; -|- 1] and 

x[fc + l]/p-x[fc] 
d/\p\ 

is the unit tangent direction vector. 

Proof: See Appendix A. ■ 



= tan 



(6) 
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Lemma 1 provides a compact formula for the tangent vector 
relating points x[fc] and x[fc + 1] on Gn,i- For notational 
brevity, we denote e = L{x.[k],x.[k + 1]). The tangent vector 
can be interpreted as a length preserving unwrapping of the 
arc between x[fc] and x[fc + 1] onto the tangent space at 
x[fc]. Furthermore, it is conveniently expressed as the product 
of a magnitude component and the normalized directional 
component. The decomposition will be exploited in codebook 
design for efficient storage. 

The tangent vector describes the shortest distance path along 
the arc from x[fc] to x[A; + 1], called the geodesic [29]. The 
geodesic can be parameterized by a single parameter t G [0, 1] 
using the tangent vector as the next lemma shows. 

Lemma 2 (Geodesic): If x[A;], x[A; + l] G Qn,i, e, ||e||, and 
e are the tangent vector emanating from x[A:] to x[fc + 1], the 
norm of the tangent vector, and the normalized tangent vector, 
respectively, then the geodesic path between x[A;] and x[fc + 1] 
is 

G(x[fc],e,t) = x[fc]cos(||el|t) +esin(||e||t) (7) 

for t e [0,1] such that G(x[fc],e,0) = x[A:] and 
G(x[fc],e,l) =x[fc + l]. 

Proof: See Appendix B. ■ 

Lemma 2 provides a convenient formula to relate points 
between x[A;] and x[fc + 1] in terms of the tangent vector and 
the step size t. To introduce the notion of prediction, we use 
the tangent vector with respect to x[fc + 1] such that it extends 
the geodesic path from x[fc] and x[/;;+l]. The translation of the 
tangent vector along the Grassmann manifold is accomplished 
by the parallel transport. 

Lemma 3 (Parallel Transport): Let x[fc], x[fc + 1] G QnA 
and e be the tangent vector emanating from x[fc] to x[fc + 1]. 
Then, the parallel transported tangent vector emanating from 
x[k + 1] along the geodesic direction e is 

d \ x[fc + l]p* - x[k] 



tan 



(8) 



Proof: See Appendix C. ■ 

Note that the general expression in [29] involves singular 
value decomposition (SVD) which is typically expensive for 
implementation. A compact form without an SVD on ^„ i 
has not appeared in the literature before to the best of our 
knowledge. Thus Lemma 3 provides a convenient expression 
for transporting the base of the tangent vector from x[k] to 
x[fc + 1]. It can be interpreted as transforming the tangent 
vector onto another tangent space connected by the geodesic. 

Using the concepts of the tangent vector, geodesic, and 
parallel transport, we propose a one step prediction for Gn,i- 

Definition 4 (One Step Grassmannian Prediction): Let 
x[A;], x[fc — 1] G Qn,i- The one step predicted vector x G Qn,i 
along the geodesic direction from x[fc — 1] to x[fc] is 



x[fc + 1] = |p|x[A;] + p*x[fc] - x[fc - 1] 



(9) 



such that d(x[fc],x[fc+ 1]) = rf(x[fc - l].x[fc]). 
See Appendix D for a detailed derivation. It is siuprising 
that the predicted vector x[fc + 1] can be computed by the 
knowledge of x[fc — 1] and x[A;] using linear operations and the 



result remains on the Grassmann manifold. This simplification 
only happens for the case of taking a full step using t = 1. 
It is also possible to consider smaller steps t < 1 d& well as 
adaptive step sizes, but we defer this to future work. 

IV. Grassmannian Predictive Coding 

In this section, we describe the proposed GPC algorithm. 
First, a general overview of the algorithm is provided. Second, 
the codebook design for encoding the error tangent vector is 
described. Finally, strategies for initialization are considered. 

A. GPC Algorithm 

Let {x[fc]}fegN S Qn,i be a correlated input sequence with 
time index k. The general operation of the proposed GPC 
algorithm closely follows that of the conventional predictive 
vector quantization technique [3]. Linear operations such as 
difference, quantization, addition, and prediction are replaced 
by equivalent operators on Grassmann manifold using the 
concepts derived in Section III. The main idea of predictive 
coding is to quantize the error e[fc] between the predicted 
vector yi[k] and the current observed vector x[fc]. The figure 
on the left hand side of Fig. 2 illustrates this graphically. 
Then, the quantized error is applied to predicted vector to 
construct the state x[fc] of the current observed vector. The 
figure on the right of Fig. 2 illustrates this graphically. The 
current and previous estimated vectors, x[A:] and x[fc — 1], 
are used to compute the predict vector x[A: + 1] as it was 
shown in Section 111 and Fig. 1. Since both the encoder and 
decoder uses estimated vectors for prediction, they both obtain 
the same predicted vectors. This is in contrast to quantizing 
x[fc] directly in the conventional one-shot approach [18]. By 
exploiting memory, predictive vector quantization offer higher 
resolution for a given number of bits. 

Fig. 3 illustrates the proposed GPC encoder; the pseudo 
code is provided in Algorithm 1. At time k, an error tangent 
vector is computed from the predicted vector i[k] to the 
current observed vector x[A:]. Using (6), the error tangent 
vector emanating from x[fc] to x[A;] is computed as 

x[fc]/p-i[fc] 

.R " 



i[k] = tan 



(10) 



||x[fc]/p-x[fc]|| 

where p = x*[A;]x[fc] and d = ^Jl — 

If C = {cj}^^ is the size Nc = 2'' codebook of error 
tangent vectors, the index of the quantized error tangent vector 
is obtained by 

i[k] = argmin rf(G(x[fc], c,, 1), x[fc]). (11) 

ie{l,2,...,Nc} 

The corresponding codeword is Cjjfej. The codeword that yields 
the geodesic map with shortest distance to the observed 
vector x[fc] is selected. For notational brevity, we denote the 
quantization step by Q : C" — )• N that takes the error tangent 
vector and outputs the codeword index, i.e., i[k] = Q{e[k]). 
The design of the codebook and efficient representation of the 
codebook for implementation will be described in IV-B. 
Continuing at the encoder, the estimated vector becomes 



x[A;] = G(x[fc],Cj[fe],l). 



(12) 
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Finally, the prediction using Definition 4 is performed using 
two previous estimates 

x[fc + 1] = |p|x[fc] + p*x[k] - x[k - 1] (13) 

where p ~ x[fc]*x[fc — 1]. For notational brevity, we denote 
the prediction operation by a map P : Q 
which takes current and previous state vectors and outputs 
the predicted vector, i.e., x[fc + 1] = P(x[fc — l],x[fc]). The 
predicted vector is used in the next step to compute the error 
tangent vector. The encoding procedure is repeated for each 
time fc + l,A; + 2,.... 

Fig. 4 illustrates the proposed GPC decoder; the pseudo 
code is shown in Algorithm 2. The same error tangent code- 
book as the encoder is assumed to be available. The received 
indices are decoded in to recover Ci[^. The predicted 
vector x[fc] is mapped to the estimated vector x[fc] using the 
codeword as in (12). Similarly to the encoder, the prediction 
is performed using (13) to obtain Sc[k + 1] for the next time 
period. Note that for the first iteration of the decoder, the 
knowledge of x[fc], or equivalently x[fc — 1] and x[fc — 2], 
is needed. Synchronizing the initial vectors with the encoder 
is important because if x[A;] is different from the encoder, the 
received codeword no longer represents the correct error tan- 
gent vector. In Section IV-C, we provide an efficient strategy 
for initialization over finite rate communication channel. With 
appropriate initialization, symmetric operation at the encoder 
and decoder yields the same predicted vector x[A:] for each 
time k. 

B. Codebook Design 

One of the strategy for PVQ codebook design is to employ 
an open loop approach followed by a closed loop approach 
to refine the codebook [3]. The open loop approach uses 
the prior vectors from a training data set to perform the 
prediction x[A;] = P(x[A; — 1], x[A;]) instead of predicting using 
the estimates, i.e. P(x[fc — l],x[fc]). The error tangent vector 
is computed using (10). Then the Lloyd iterative algorithm 
is used to obtain the open-loop codebook. Using the code- 
book obtained using the open-loop codebook design, GPC is 
performed on the training data set to obtain a sequence of 
error tangent vectors. The Lloyd iteration is performed on the 
closed-loop error tangent vectors to obtain the final codebook. 
It is difficult to show the Lloyd iteration optimahty of the open- 
loop and closed-loop approaches due to the feedback structure 
of the GPC but these approaches have been known to provide 
good results in the PVQ literature [3]. Thus, in this paper, we 
employ the open-loop and closed-loop approach to obtain the 
error tangent vector codebook. 

For storage of the codebook, we propose an efficient code- 
book representation by exploiting the product structure of 
the tangent space. We quantize separately the tangent vector 
magnitude and direction [3]. Shape-gain vector quantization 
is widely used, for example, in speech and video coding [41]. 
We use the shape-gain decomposition to provide efficient 
codebook storage and exploit it to analyze the rate-distortion of 
the proposed GPC that is otherwise very difficult. The tangent 
magnitude ||e[A;]|| is dependent on the distance between the 



predicted vector and the observed vector, which in turn is 
dependent on the rate of change of the input vectors. The unit 
norm error tangent vector depends on the location at which the 
tangent is computed and the directional statistics of the error. 
If C is the obtained error tangent codebook of size Nc, the 
shape-gain decomposed codebooks are Cd = {cd,i}f=i for the 
error tangent direction codebook and Cm = {cm,i]i=i for the 
error tangent magnitude codebook. The desired codeword is 
reconstructed as Cj[fc] = Cra.i[k]Cd,i[k] time k. With some 
heuristic design, it is possible to express, for example, a 
size 4-bit codebook of vectors by a size 2-bit codebook of 
scalars representing the magnitude and a size 2-bit codebook 
of vectors representing the normalized tangent directions. Thus 
codebook storage reduction is possible at an expense of extra 
computation to reconstruct the codeword. 

C. Initialization 

Similar to the PVQ, the initial states of the GPC at both the 

encoder and the decoder needs to match to obtain the correct 
results. For example, in next generation wireless standards 
such as IEEE 802.16m, various feedback initiaUzation inter- 
vals are defined [42, Sec. 16.3.6]. Thus, an efficient mechanism 
for initialization is also important. Two approaches may be 
considered for initiaUzation. One approach is to perform an 
initialization process so that the two estimated vectors x[fc — 1] 
and x[/c — 2] are communicated from the encoder to the 
decoder. Since the complete description of x[fc— 1] and x[fc— 2] 
must be communicated to the decoder, there is system depen- 
dent communication overhead. Another approach is to use the 
one-shot memoryless quantization technique to initiaUze the 
two vectors. This approach is attractive because it does not 
add any implementation overhead to systems already using 
one-shot feedback approach, e.g. 3GPP LTE. In particular, if 
the same codebook is used for the error tangent direction 
codebook and one-shot memoryless quantization codebook, 
there are no codebook memory overhead resulting in efficient 
implementation. A consequence of using memoryless quanti- 
zation approach for initialization is that there may be an initial 
transient period in which the quantization error is larger than 
the steady state condition. As we show in Section V, this is 
because the memoryless quantization generally results in a 
larger quantization error. 

V. Performance Analysis of GPC 

In this section, we provide a quantization error analysis 
under a small angle approximation. We derive upper and lower 
distortion bounds, and then derive closed loop gain metric for 
the GPC algorithm. 

A. Small Angle Approximation 

In this section we use the locally Euclidean property of the 
Grassmann manifold to derive an expression for the prediction 
error as a function of the tangent vector. If y € Gn,i is obtained 
by changes to x e Gn,u we can approximate the chordal 
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distance between x and y as 

rf(x, y) = v^l - |x*y|2 

= |sin(0)| (14) 

« ||x-y|l (15) 

where (14) follows from the subspace angle of vectors [35] and 
(15) follows from the small angle approximation. Thus, for a 
sufficiently small perturbation around x, the subspace distance 
between x and y is approximated by the usual Euclidean 
distance. 

We may express the current observed vector at time k, x[k], 
in terms of the predicted vector and the error tangent vector 
as 

x[fc] = G{x[k],e[k],l) 
« x[fc]+e[fc]||e[A;]|| 
= x[fc] + e[fc] (16) 

using the small angle approximation. Furthermore, 

x*[fc]x[A;] « (5c[fc] + e[A;])*(x[fc] + e[k]) 

= 1 + 2||e[fc]||5i(e[fc]*x[fc]) + \\e[k]f (17) 
RJ 1. 

The second term, e*[fc]x[fc], in (17) is zero because the unit 
norm tangent vector e[A;] is orthogonal to x[fc]. Similarly, if 
Cj[fc] is the selected error tangent codeword, the estimated 
signal can be expanded as 

x[k] = G(x[fc],Ci[fe],l) 

« i[k]+Ci[k]. (18) 

Both (16) and (18) reveal that for a small enough change, both 
vectors are expressed as an additive correction to the predicted 
vector. Thanks to the locally Euclidean property and using the 
usual 2-norm for the local difference, the prediction error is 

||x[fc]-i[fc]|| « ||e[fc]-c,[fe]||. (19) 

Therefore, the estimation error can be approximated as the 
normed difference between the actual tangent vector and 
the quantized tangent vector. Thus for small changes in the 
observed vector, the accuracy of tangent direction and tangent 
magnitude determines the accuracy of the estimate. 

B. Distortion Bounds 

The average distortion induced by a quantizer is a typical 
measure of performance. In what follows, we derive an upper 
and lower bound on the distortion for the proposed GPC 
algorithm. Recall that a metric ball Bs(z) with radius S 
centered at z e Qn,i on the Grassmann manifold is defined as 

S5(z) = {yeg„,i :d(y,z)<,5} (20) 

such that Bs{z) c Qn,i- A closed form volume formula for 
Bs{z) is given as [43] 

Vol(B5(z)) = 52("-i). (21) 

Consider B^{z) c Qn,i with ^ < 7 and volume of Bs{z) 
given by (21). Let (rfy) denote the differential form of the 



Haar measure on Qn,i- The distortion in the ball normalized 
by the volume of the ball was shown to be [7, Lemma 1] 

7b,(z) Vol(i?^(z)) \ 2n J ' 

For memoryless quantization, the volume together with a point 
density and covering assumption over the entire Gn,i are used 
to characterize distortion. For the proposed GPC algorithm, 
the Voronoi region is determined by the tangent direction 
and tangent magnitude codebooks which makes the covering 
argument difficult. To overcome this difficulty, we assume that 
the tangent magnitude codebook provides concentric annular 
partitions of the sphere cap centered around the predicted 
vector and the tangent direction codebook partitioning each 
annulus into equiangle sectors. We obtain the bounds by 
considering the ball that is enclosed in the smallest annular 
sector and the ball that encloses the largest annular sector. 
Similarly, the distortion upper bound is given by the volume 
of the ball that covers the Voronoi cell. 

Let 7d = minc^ .,crf,fceCd,i#fe'^(cd,nCd,fe) denote the 
minimum chordal distance between the tangent direc- 
tion codewords and 7™ = minc„_,,c„,fc6C„,i#fc \c,n,i - 
c„,_fc| denote the minimum Euclidean distance between 
the tangent magnitude codewords. Similarly, let = 
maxc^ ,,cd,fcec<i,i#fcrf(cd,i,Cd,fc) denote the maximum chordal 
distance between the tangent direction codewords and X„i = 
maxc^ . ^Cn.keCm.ij^k \cm,i - Cm,k\ denote the maximum Eu- 
cUdean distance between the tangent magnitude codewords. 
Suppose that the tangent direction and magnitude codebooks 
maps uniformly to an equiangle sectors of concentric annulus 
centered at the predicted vector. Then the following lemma 
provides the bounds on the distortion for GPC algorithm. 

Lemma 5 (Distortion bounds): If 7iower = T^^i^ijd-.Jm} 
and Aupper = maxjAd, Am}, lower and upper quantization 
distortion bounds are given by 

^ - (^) 

Proof: The lower bound is given by the volume of a 
metric ball that has ball radius which is smaller of the half 
minimum chordal distance of tangent direction codebook and 
half minimum distance of tangent magnitude codebook. The 
upper bound is similarly obtained by considering the volume 
of a metric ball which covers a Voronoi region. The bounds 
are exact since the metric ball volume formula is accurate [7, 
Lemma 1]. ■ 
No claim is made on the tightness of the bound since an 
accurate description of the Voronoi region obtained by the 
proposed tangent codebook remains an open problem. In 
Section VI-A, we provide numerical examples comparing the 
bounds obtained with actual distortion using fixed codebooks. 

Using the obtained lower bound, we may further quantify 
the reduction in distortion lower bound compared to memo- 
ryless quantization on the Grassmann manifold. For Qn,i, the 
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lower bound on the fixed rate quantizer on the Grassmann 
manifold was shown to be 



2(n- 1) 
2n 



N- 



(24) 



where N is the size of the codebook with rate log2 (N) bits [6], 
[7]. Suppose that 7iower is dominated by the tangent direction 
codebook such that 'yiower = 7d and that Grassmannian 
codebook is used for the tangent direction codebook. Then, 
the lower bound for the GPC algorithm can be expressed as 



D 



lower 



1 f2{n~ 1) 



4 V 2n 
1 / 2(n-l) 
4 I 2n 



(25) 



showing that the lower bound is smaller than Dg^ ^ i^d) when 

7d < 7m- 

C. Performance Measures 

The closed loop prediction gain ratio is often used in 
vector quantization literature [3] as a measure of how well 
the predictor performs with respect to the changes in the 
input. The closed loop prediction gain is usually written as 
the ratio of mean squared norm of the observed signal over 
mean squared norm of the prediction error. We define the mean 
squared error to be E[(i^(x[fc],x[A;])]. For our GPC algorithm, 
we measure the closed loop prediction performance by 



Gdp — 



E[||x[fc]H^ 
E[d'^{x[k],x 
1 

E[d2(x[fc],x[A;])] 



(26) 



where rf2(x[fc],x[fc]) denotes the squared chordal prediction 
error. In fact, (26) can be further expressed as a function of 
the tangent vector assuming that the small angle approximation 
holds. Using (15) and (16), the distance function in the 
denominator can be approximated as (i(x[fc], x[fc]) « ||e[fc]||. 
Therefore, the closed loop prediction gain for GPC algorithm 
becomes 



1 



clp 



E[||e[fc]||^ 



(27) 



which shows the dependence of the closed loop prediction gain 
performance on the tangent magnitude. The tangent magnitude 
is in tum dependent on the changes in the observed process. A 
closed form relationship between the observed process and the 
tangent magnitude is in general difficult to obtain. In Section 
VI-B, we show some empirical results of the closed loop 
prediction gain performance for the proposed GPC algorithm. 

VI. Simulation Results 

In this section, we provide numerical results to illustrate the 
performance of the proposed GPC algorithm. 



A. Distortion Bounds 

We present a numerical example illustrating the opera- 
tional distortion and compare it with the upper and lower 
bounds given in Lemma 5. Correlated 3x1 vectors were 
generated according to a second order autoregressive model 
with memory coefficients ai = 0.9 and a-i = 0.75 with 
additive noise distributed according to zero mean complex 
Gaussian with variance (0.01)^, i.e., h[fc] = Q!ih[fc — 1] + 
a2h[A: — 2] + \Jl — a\ — a|z[fc]. The normalized vectors 
were considered to be the samples on ^31 to which the 
proposed GPC algorithm was applied. For this experiment, an 
Nd = 2^ tangent direction codebook was used and the tangent 
magnitude codebook size was varied from Nm = 2^ to 2^. 
Fig. 6 shows the operational distortion with upper and lower 
distortion bounds obtained in Lemma 5 as a function of the 
tangent magnitude codebook size. The lower bound captures 
the distortion trend over the range of codebook sizes while 
the upper bound seems too loose. We also illustrate the lower 
bound of a memoryless quantization using a Grassmannian 
codebook with codebook sizes of 6, 7, 8, and 9 bits so that 
the total number of bits used for the codebook matches that 
of the proposed GPC algorithm. We see that the proposed 
GPC algorithm provides significant improvement in distortion 
over the memoryless quantization technique. Unfortunately, 
the upper bound from Lemma 5 is dominated by the resolution 
of the 4-bit tangent direction codebook which has higher 
distortion than the memoryless quantization with adjusted 
number of codebook size. Nevertheless, the result shows that a 
significant reduction in distortion is achieved by the proposed 
GPC algorithm and the achievable distortion can be controlled 
by the tangent magnitude codebook which is a simple scalar 
codebook. 

B. Closed Loop Prediction Gain and Prediction Error 

To illustrate the dependence on the tangent direction and 
tangent magnitude codebooks. Fig. 7 shows the closed loop 
prediction gains for various error tangent magnitude codebook 
sizes and fixed tangent direction codebook of size Nd = 64. 
For these numerical examples, a correlated 4x1 vector 
sequence was generated according to a first order autoregres- 
sive model (or Gauss-Markov model [44]) with correlation 
coefficient a = Jo(27r/3) where Jo is Bessel function of 
zeroth order and /3 is the normalized Doppler frequency. The 
sequence of channel coefficients are generated according to 



h[A;] = ah[k -1] + ^1 - a^z[k] 



(28) 



where k is the time index and z[k] is a Nt x 1 vector with 
each entry drawn from an i.i.d. zero mean complex white 
Gaussian process. The normalized vectors x[fc] = h[fc]/||h[fc] || 
are the correlated sequence on the Grassmann manifold. For 
the tangent direction codebook, an Nd = 2^ Grassmannian 
codebook [45] was used and the tangent magnitude codebooks 
were based on a uniform quantization between and 1 using 
2, 3, 4, and 5 bits. For an upper bound, the closed loop 
prediction gain without quantizing the tangent magnitude is 
also shown. The result illustrates the dependence of closed 
loop prediction gain on tangent magnitude codebook size as a 
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function of correlation parameter /?. For highly correlated data, 
the tangent magnitude codebook resolution has higher impact 
on the closed loop prediction gain. This is because the smallest 
tangent magnitude quantization level may be larger than the 
prediction error leading to an over estimation. If the tangent 
magnitude codebook is adjusted based on the correlation, e.g., 
quantize in the range of [0, 0.1] instead of [0, 1], this gap may 
be closed. 

Another useful performance measure is the chordal distance 
error between the estimated vector x[k] and the observed 
vector x[fc]. The chordal distance error d(x[A:],x[fc]) shows 
how close the estimated vector is to the observed vector 
using the proposed GPC algorithm. In MIMO communication 
application considered in VI-C, the chordal distance error has 
a direct impact on the respective communication theoretic 
performance measures. In Fig. 8, we show the chordal distance 
between x[/c] and x[fc] and the chordal distance between the 
quantized vector and the observed vector for memoryless 
quantization using Grassmannian codebook with = 2*^. 
Fig. 8 illustrates the substantial improvement in the quanti- 
zation accuracy compared with memoryless technique. 

To further illustrate the quantizer accuracy, we show the 
operational mean squared chordal distance error (MSB) as 
a function of /3 for the proposed GPC algorithm and mem- 
oryless quantizer using Grassmannian codebook in Fig. 9. 
The memoryless quantizer provides approximately — 7 dB of 
MSE whereas the proposed GPC algorithm provides as little 
as —26 dB of MSE which shows that significant accuracy 
can be obtained over memoryless quantization techniques. As 
the correlation decreases, the MSE approaches that of the 
memoryless quantization MSE. 

C. Application to Zero Forcing Multiuser MIMO System 

In this section, we illustrate the application of proposed 
GPC algorithm to limited feedback multiuser MIMO system 
using zero forcing precoding [30]. We assume that the trans- 
mitter has = 4 transmit antennas and each user is equipped 
with single receive antenna. We assume that the encoder and 
decoder are initialized and that each user has a perfect channel 
estimate. Then, each user performs the prediction as described 
in Section IV and feedback the indices of quantized tangent 
direction and tangent magnitude codewords. The transmitter 
uses the received indices and performs the prediction as de- 
picted in Fig. 4. Then, the predicted channel vectors are used to 
form the composite channel matrix to compute the zero forcing 
precoder The channel to each user is assumed to be temporally 
correlated with correlation according to Joi^nfoTs) [46]. 
Each user's channel is independently generated assuming same 
temporal correlation. 

To compare the random codebook approach and the pro- 
posed GPC algorithm, we compare the achievable sum rate 
for three scenarios. First, the achievable sum rate assuming 
perfect CSI at the transmitter is obtained. For the perfect CSI 
case, i.i.d. channel is assumed. The perfect CSI case provides 
the baseline for what can be achieved. The second scenario 
is the random vector codebook approach also assuming i.i.d. 
channel [30]. Finally, the proposed GPC algorithm using 9- 
bit codebook for foT^ = 0.001,0.01,0.02, and 0.04 that 



corresponds to Doppler frequencies of 0.2Hz, 2Hz, 4Hz, and 
8 Hz at 5ms update intervals that is found in LTE-Advanced 
and IEEE 802.16m. 

Fig. 10 illustrates the achievable sum rate for cases being 
considered. Contrary to the random codebook strategy, the 
proposed GPC algorithm provides significant sum rate gain. In 
fact, for foTs = 0.001, the system starts to become interfer- 
ence Umited above SNR of 20dB illustrating the superior CSI 
accuracy when the channel is highly correlated. Furthermore, 
each user is equipped with the same codebooks which elimi- 
nates the need to store multiple codebooks at the transmitter, 
thus reducing the overhead for practical applications. 

Fig. 1 1 illustrates the sum rate improvement of the proposed 
technique over the Householder technique in [26] over a range 
of SNR for channels with various normalized Doppler fre- 
quencies. Both methods used 9-bit feedback per channel use. 
The plot shows that the proposed GPC algorithm outperforms 
the Householder technique especially at high SNR illustrating 
higher CSI resolution obtained by the GPC algorithm. 

VII. Conclusion 

In this paper, we proposed a new predictive coding algo- 
rithm on the Grassmann manifold for limited feedback in 
multiple antenna wireless systems. Building on the classical 
predictive vector quantization on linear vector space and the 
geometric properties of the Grassmann manifold, we derived 
a predictive coding framework for Gn,i- Distortion bounds 
were obtained showing possible distortion improvement over 
memoryless quantization technique. In simulations we showed 
that the proposed GPC algorithm provides significant sum 
rate improvement for multiuser MIMO system using practical 
codebook size. Future work should consider the optimization 
of the tangent magnitude codebook and extensions to a higher 
dimensional Grassmann manifold, i.e., Gn,p for p > I. 

Appendix A 
Proof of Lemma 1 

Proof: It was shown in [47] that the tangent vector 
between xi and X2 in Qn i can be written as 



e = tan 



X2 



- Xi 



X2/p - Xi 
||x2/p-Xi| 



(29) 



The normed term can be simplified as 

2 



X2 



- Xi 



X2 
P 



Xl 



X2 
P 



Xl 



- 1. 



(30) 



Therefore, 



X2 

P 



■ Xl 




where d = \J\ — |pp is the chordal distance between Xi and 
X2. Clearly, ||e|| = tan~-^((i/||p|) > and e = (X2//) — 
xi)/(rf/|p|) such that e = ||e||e. 
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Using the exponential form of trigonometric identities 
tan-i(a;) = (j72)ln{(l - jx)/{l + jx)} and cos-i(x) = 
—j In (a; + ^x'^ — 1), we have 



tan 



I -J 




In 

-jH\p\ + VW 



1) 



(31) 



Since \p\ is the cosine of the subspace angle between xi and 
X2, this shows that the norm of the tangent vector is equal to 
the arc length, i.e., \6\ with subspace angle 9 [35, p. 603]. ■ 

Appendix B 
Proof of Lemma 2 

Proof: For the general case where Xi, X2 S Qn,p with 
n > p > 0, the geodesic between Xi and X2 was shown to 
be [29] 

X(i) = XiVcos(St)V* +Usin(Si)V* 

where USV* is the compact singular value decomposition of 
the tangent emanating from Xi to X2. For the case xi, X2 e 
Gn,i, let e be the tangent vector emanating from xi to X2. 
Then, we may assume V = 1 without loss of generality and 
identify U with e and E with ||e|| to obtain 

G'(xi,e,t) = XiCOs(||e||<) +esin(||e||f). (32) 

It is clear that G(xi, e, 0) = xi. At t = 1, we have 

G(xi,e,l) 



Xl 



+ "^//,-"^ JM= (33) 

d/\p\ yiTrfW 

(34) 

X2 



where we have used the identities 

sin(a;) = 



cos(x) = 



VTTx^ 
1 



(35) 



in (33) and the fact that p^l + d2/|pp = 1 in (34). 

To verify that G(xi , e, t) for t e [0, 1] is a valid point on the 
Grassmann manifold, taking the inner product of G(xi,e,t) 
with itself yields 1 for t e [0, 1] by using the fact that Xi _L e. 



Appendix C 
Proof of Lemma 3 

Proof: For the general case where Xi, X2 e Qn,p, n > 
p > 0, the parallel transport of tangent E emanating from Xi 
along the geodesic direction A with compact singular value 
decomposition, USV*, was shown to be [29] 

E = [-XiVsin(Si)U* + Ucos(Ei)U* + (I - UU*)] E. 

(36) 



We need to show the parallel transport of the tangent vector 
e emanating from xi to X2 in the geodesic direction e for the 
case Xl, X2 G GnA- Without loss of generality, we assume 
that the singular value decomposition of e is given with e as 
the left singular vector, ||e|| as the singular value, and 1 for 
the right singular vector. Then 

e(t) = [-xie*sin(||e||t) + ee*cos(||e||t) + (I-ee*)]e 
= -xi||e||sin(||e||t) +ecos(||e||f). (37) 

Since G(xi, e, 1) = X2, the parallel transported tangent vector 
emanating from X2 is found by evaluating (37) for t = 1. 
Using (6) and (35), we have 

e = -xi||e|| sin(||e||) + ecos(||e||) 
-xitan-i(d/|p|)(rf/|p|) 

tan-i(rf/|p|)(x2/p-xi) 1 



+ 



d/\p\ 
tan-i(d/|p|) 



X2 



id/\p\)^i + dy\p\'^ V P 

X2P* - Xl 



1 + ^ 



tan 



d 



(38) 



which is the desired result. 



Appendix D 

Derivation of Prediction Function in Definition 4 

Recall that the parallel transported tangent vector e ema- 
nating from X2 is given in (8). Computing the geodesic with 
from X2 along e at f = 1 gives 



X = G(x2,e, 1) 

X2 



X2P' - Xl 



= |p|x2 + /5*X2 - Xl. (39) 

To see that x e Gn,i, we have 

X*X = (|p|x2 +p*X2 - Xi)*(|p|x2 +p*X2 - Xl) 

= 1 (40) 

where we have used the fact that p = xfx2. To see that the 
prediction is distance preserving, the inner product of X2 and 
X gives 

X2X = X2X2I/9I -I-X2X2P* -X2X1 

= \p\. (41) 



Therefore, 



rf(x2,x) = Vl - IpP = rf(xi,X2). 



(42) 
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Algorithm 1 GPC encoder algorithm 



Input: x[fc] 

1: Initialize x[l] and x[0] 
2: for all k=l,2,. .. do 

3: e[fc] = L(i[fc],x[A:]) 
4: i[k] = Qie[k]) 
5: x[k] = G(x[A;],Cj[fc], 
6: + 1] = P(i[fc - 

7: end for 
Output: i[fc] 



i[k] 



x[fc]) 







G 


— >^ 



:[k] 



Algorithm 2 GPC decoder algorithm 

Input: i[k] 

1: Initialize x[l] and x[0] 
2: for all k=l,2,. .. do 

3: C,[fc] = Q~l(i[fc]) 

4: X[fc] = G(x[/c],C,[fc],l) 

5: xifc + 1] =P(i[fc-l],x[fc]) 
6: end for 
Output: x[fc] 



Fig. 4: Block diagram of predictive decoder on the Grassmann 
manifold. 



Tangent plane at x[fc] 




Predicted value based on 
parallel transported tangent. 



Fig. 1: Conceptual illustration of the tangent vector and the 
parallel transport on the Grassmann manifold. 



Lower bound ball 
with radius 7lov 



Upper bound ball 
with radius O'upper 




Fig. 5: Illustration of quantization region around the predicted 
vector and lower and upper distortion bound balls. 
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Fig. 2: Conceptual illustration of obtaining prediction error 
(left) and quantizing the prediction error to obtain the esti- 
mated vector (right). 
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Comparison of Distortion 
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Fig. 6: Comparison of operational distortion against the lower 
and upper bound for various tangent magnitude codebook size. 
The lower distortion bound for the memoryless quantizer using 
Grassmannian codebook is also shown. 



Fig. 3: Block diagram of predictive encoder on the Grassmann 
manifold. 
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Closed-Loop Prediction Gain 
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Fig. 7: Closed loop prediction gain, Gdp, for Q41 data with 
fixed tangent codebook (Nd = 64) and different tangent 
magnitude codebooks {N„i — 2^,2^,2^,2'^) over various 
correlation parameter /3. 



Comparison of Chordal Distance Error Over Time 
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Fig. 8: Chordal distance comparison over time between mem- 
oryless quantizer using 9-bit Grassmannian codebook and the 
proposed GPC algorithm using 9-bit codebook. 



IVIean Squared Error 
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Fig. 10: Sum rate for A^f = C/ = 4 i.i.d. channel with perfect 
CSI, i.i.d. channel with 9-bit Grassmannian codebook, and 
the proposed GPC algorithm with 9-bit codebook for various 
normalized Doppler frequencies. 



Sum Rate Improvement for GPC over Householder method 
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Fig. 11: Sum rate improvement obtained by the proposed GPC 
algorithm over Householder technique for Nt = U = A using 
9-bit codebook for various normalized Doppler frequencies. 



Fig. 9: Mean squared error comparison between memoryless 
quantization using 6-bit and 9-bit Grassmannian codebook and 
the proposed GPC algorithm using 9-bit codebook. 



